System and Method of Cyclic Boosting for Explainable Supervised Machine Learning

ABSTRACT

A system and method are disclosed including a computer and a processor and memory. The computer receives historical sales data comprising aggregated sales data for one or more items from one or more store for at least one past time period. The computer further trains a cyclic boosting model to learn model parameters by iteratively calculating for each feature and each bin factors for at least one full feature cycle. The computer further predicts one or more demand quantities during a prediction period by applying a prediction model to historical supply chain data, wherein a training period is earlier than the prediction period, and each of the one or more demand quantities is associated with at least one item of the one or more items and at least one stocking location of the one or more stocking locations during the prediction period and rendering a demand prediction feature explanation visualization.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.16/653,642, filed on Oct. 15, 2019, entitled “System and Method ofCyclic Boosting for Explainable Supervised Machine Learning,” whichclaims the benefit under 35 U.S.C. § 119(e) to U.S. ProvisionalApplication No. 62/790,204, filed Jan. 19, 2019, and entitled “Systemand Method of Cyclic Boosting for Explainable Supervised MachineLearning.” U.S. patent application Ser. No. 16/653,642 and U.S.Provisional Application No. 62/790,204 are assigned to the assignee ofthe present application.

TECHNICAL FIELD

The present disclosure relates generally to machine learning andspecifically to quantifying the contribution of feature variables thatinfluence a machine learning prediction.

BACKGROUND

Supervised machine learning methods have seen remarkable advances andsurpassed human-level performance in a wide range of specificapplications. Although predictions obtained from many supervised machinelearning methods are very accurate, the exact path how an individualprediction was calculated is typically not observable in complexensemble or deep learning models. In addition, most machine learningtechniques struggle to learn rare observations, like special holidayeffects, which may have an outsized effect on predictions. The inabilityto identify the underlying cause of predictions and to learn rareobservations with machine learning techniques is undesirable.

BRIEF DESCRIPTION OF THE DRAWINGS

A more complete understanding of the present invention may be derived byreferring to the detailed description when considered in connection withthe following illustrative figures. In the figures, like referencenumbers refer to like elements or acts throughout the figures.

FIG. 1 illustrates an exemplary supply chain network, in accordance witha first embodiment;

FIG. 2 illustrates the cyclic boosting system, the archiving system, andthe planning and execution system of FIG. 1 in greater detail, inaccordance with an embodiment;

FIG. 3 illustrates a method of cyclic boosting, in accordance with anembodiment;

FIG. 4 illustrates a method of calculating model parameters of a cyclicboosting model, in accordance with an embodiment;

FIG. 5 illustrates a chart of smoothed factors, predictions, and truthfor the feature variable “item” after a final iteration, in accordancewith an embodiment;

FIG. 6 illustrates a chart of smoothed factors, predictions, and truthfor the feature variable “day of the week” after a final iteration, inaccordance with an embodiment;

FIGS. 7A-7D illustrate visualizations comprising an exemplarytwo-dimensional feature, in accordance with an embodiment;

FIG. 8 illustrates a quadratic loss function visualization, inaccordance with an embodiment;

FIG. 9 illustrates a profile histogram visualization, in accordance withan embodiment;

FIG. 10 illustrates a features combination visualization, in accordancewith a first embodiment; and

FIG. 11 illustrates a features contribution visualization, in accordancewith a second embodiment.

DETAILED DESCRIPTION

Aspects and applications of the invention presented herein are describedbelow in the drawings and detailed description of the invention. Unlessspecifically noted, it is intended that the words and phrases in thespecification and the claims be given their plain, ordinary, andaccustomed meaning to those of ordinary skill in the applicable arts.

In the following description, and for the purposes of explanation,numerous specific details are set forth in order to provide a thoroughunderstanding of the various aspects of the invention. It will beunderstood, however, by those skilled in the relevant arts, that thepresent invention may be practiced without these specific details. Inother instances, known structures and devices are shown or discussedmore generally in order to avoid obscuring the invention. In many cases,a description of the operation is sufficient to enable one to implementthe various forms of the invention, particularly when the operation isto be implemented in software. It should be noted that there are manydifferent and alternative configurations, devices and technologies towhich the disclosed inventions may be applied. The full scope of theinventions is not limited to the examples that are described below.

FIG. 1 illustrates exemplary supply chain network 100, in accordancewith a first embodiment. Supply chain network 100 comprises cyclicboosting system 110, archiving system 120, one or more planning andexecution systems 130, inventory system 140, transportation network 150,one or more supply chain entities 160, computer 170, network 180, andcommunication links 190 a-190 g. Although a single cyclic boostingsystem 110, a single archiving system 120, one or more planning andexecution systems 130, a single inventory system 140, a singletransportation network 150, one or more supply chain entities 160, asingle computer 170, and a single network 180, are shown and described,embodiments contemplate any number of cyclic boosting systems, archivingsystems, one or more planning and execution systems, inventory systems,transportation networks, supply chain entities, computers, or networks,according to particular needs.

In one embodiment, cyclic boosting system 110 comprises server 112 anddatabase 114. As explained in more detail below, cyclic boosting system110 uses a machine learning method to train a prediction model fromhistorical sales data and to generate a prediction when current data 226(FIG. 2 ) is applied to the trained model. Cyclic boosting system 110may receive historical data and current data from archiving system 120,one or more planning and execution systems 130, inventory system 140,transportation network 150, one or more supply chain entities 160,and/or computer 170 of supply chain network 100, as described in moredetail herein. According to some embodiments, cyclic boosting system 110performs regression or classification on historical data to generatepredictions from current data, identify the one-dimensional andmulti-dimensional features that affect the value of individualpredictions, and calculate the influence that each feature contributesto the prediction. As described in greater detail below, predictions maycomprise a retail volume (such as, for example, demand or sales volume,order quantities for replenishment, pricing targets, and the like) orclassifications (such as, for example, identifying customers targetedfor coupon or discounts, predicting the occurrence of a future event,and the like). In addition, server 112 comprises one or more modulesthat provide a user interface (UI) that displays visualizationsidentifying and quantifying the contribution of features to anindividual prediction.

Archiving system 120 of supply chain network 100 comprises server 122and database 124. Although archiving system 120 is shown as comprising asingle server 122 and a single database 124, embodiments contemplate anysuitable number of servers or databases internal to or externallycoupled with archiving system 120. Server 122 of archiving system 120may support one or more processes for receiving and storing data fromone or more planning and execution systems 130, inventory system 140,transportation network 150, one or more supply chain entities 160,and/or computer 170 of supply chain network 100, as described in moredetail herein. According to some embodiments, archiving system 120comprises an archive of data received from one or more planning andexecution systems 130, inventory system 140, transportation network 150,one or more supply chain entities 160, and/or computer 170 of supplychain network 100. Archiving system 130 provides archived data to cyclicboosting system 110 and/or planning and execution system 130 to, forexample, train a machine learning model or generate a prediction from atrained machine learning model. Server 122 may store the received datain database 124. Database 124 of archiving system 120 may comprise oneor more databases or other data storage arrangement at one or morelocations, local to, or remote from, server 122.

According to an embodiment, one or more planning and execution systems130 comprise server 132 and database 134. Supply chain planning andexecution is typically performed by several distinct and dissimilarprocesses, including, for example, demand planning, production planning,supply planning, distribution planning, execution, transportationmanagement, warehouse management, fulfilment, procurement, and the like.Server 132 of one or more planning and execution systems 130 comprisesone or more modules, such as, for example, a planning module, a solver,a modeler, and/or an engine, for performing actions of one or moreplanning and execution processes. Server 132 stores and retrieves datafrom database 134 or from one or more locations in supply chain network100. In addition, one or more planning and execution systems 130 operateon one or more computers 170 that are integral to or separate from thehardware and/or software that support archiving system 120, inventorysystem 140, transportation network 150, and one or more supply chainentities 160.

Inventory system 140 comprises server 142 and database 144. Server 142of inventory system 140 is configured to receive and transmit item data,including item identifiers, pricing data, attribute data, inventorylevels, and other like data about one or more items at one or morelocations in the supply chain network 100. Server 142 stores andretrieves item data from database 144 or from one or more locations insupply chain network 100. Each item may be represented in supply chainnetwork 100 by an identifier, including, for example, Stock-Keeping Unit(SKU), Universal Product Code (UPC), serial number, barcode, tag, aradio-frequency identification (RFID) tag, or like objects that encodeidentifying information and which may be scanned to read the encodedinformation and at least partially identified based on the scan. Thismay include, for example, a stationary scanner located at one or moresupply chain entities 160 that scans items as the items pass near thescanner such as, for example, a point of sale system at one or moreretailers that records transactions and associates the transactions withproduct data 254, including, for example, associating customer identityinformation, store identity and location, market information, timeinformation, price information, discount information, and the like, asdescribed in more detail herein. Embodiments also include, for example,a scanner located at one or more stocking locations of one or moresupply chain entities 160 that automatically identifies when an item isreceived into or removed from the one or more stocking locations.

Transportation network 150 comprises server 152 and database 154.According to embodiments, transportation network 150 directs one or moretransportation vehicles to ship one or more items between one or moresupply chain entities 160, based, at least in part, on a predictedretail volume or classification, an identification of one-dimensional ormulti-dimensional features affecting one or more predictions, thecalculated factor for one or more features, an inventory policy, targetservice levels, the number of items currently in stock at one or moresupply chain entities 160, the number of items currently in transit inthe transportation network 150, a supply chain disruption, and/or one ormore other factors described herein. One or more transportation vehiclescomprise, for example, any number of trucks, cars, vans, boats,airplanes, unmanned aerial vehicles (UAVs), cranes, robotic machinery,or the like. Transportation vehicles may comprise radio, satellite, orother communication that communicates location information (such as, forexample, geographic coordinates, distance from a location, globalpositioning satellite (GPS) information, or the like) with cyclicboosting system 110, archiving system 120, one or more planning andexecution systems 130, inventory system 140, and/or one or more supplychain entities 160, to identify the location of one or moretransportation vehicles and the location of any inventory or shipmentlocated on one or more transportation vehicles.

As shown in FIG. 1 , supply chain network 100 comprising cyclic boostingsystem 110, archiving system 120, one or more planning and executionsystems 130, inventory system 140, transportation network 150, and oneor more supply chain entities 160 may operate on one or more computers170 that are integral to or separate from the hardware and/or softwarethat support cyclic boosting system 110, archiving system 120, one ormore planning and execution systems 130, inventory system 140,transportation network 150, and one or more supply chain entities 160.One or more computers 170 may include any suitable input device 172,such as a keypad, mouse, touch screen, microphone, or other device toinput information. Output device 174 may convey information associatedwith the operation of supply chain network 100, including digital oranalog data, visual information, or audio information. One or morecomputers 170 may include fixed or removable computer-readable storagemedia, including a non-transitory computer readable medium, magneticcomputer disks, flash drives, CD-ROM, in-memory device or other suitablemedia to receive output from and provide input to supply chain network100.

One or more computers 170 may include one or more processors 176 andassociated memory to execute instructions and manipulate informationaccording to the operation of supply chain network 100 and any of themethods described herein. In addition, or as an alternative, embodimentscontemplate executing the instructions on one or more computers 170 thatcause one or more computers 170 to perform functions of the method. Anapparatus implementing special purpose logic circuitry, for example, oneor more field programmable gate arrays (FPGA) or application-specificintegrated circuits (ASIC), may perform functions of the methodsdescribed herein. Further examples may also include articles ofmanufacture including tangible non-transitory computer-readable mediathat have computer-readable instructions encoded thereon, and theinstructions may comprise instructions to perform functions of themethods described herein.

In addition, and as discussed herein, supply chain network 100 maycomprise a cloud-based computing system having processing and storagedevices at one or more locations, local to, or remote from cyclicboosting system 110, archiving system 120, one or more planning andexecution systems 130, inventory system 140, transportation network 150,and one or more supply chain entities 160. In addition, each of the oneor more computers 170 may be a work station, personal computer (PC),network computer, notebook computer, tablet, personal digital assistant(PDA), cell phone, telephone, smartphone, wireless data port, augmentedor virtual reality headset, or any other suitable computing device. Inan embodiment, one or more users may be associated with cyclic boostingsystem 110 and archiving system 120. These one or more users mayinclude, for example, an “administrator” handling machine learning modeltraining, administration of cloud computing systems, and/or one or morerelated tasks within supply chain network 100. In the same or anotherembodiment, one or more users may be associated with one or moreplanning and execution systems 130, inventory system 140, transportationnetwork 150, and one or more supply chain entities 160. These one ormore users may include, for example, a “manager” or a “planner”predicting values or classifications for retail and/or supply chainplanning using trained machine learning models, and/or one or morerelated tasks within supply chain network 100. In addition, or as analternative, these one or more users within supply chain network 100 mayinclude, for example, one or more computers programmed to autonomouslyhandle, among other things, assortment planning, demand forecasting,supply and distribution planning, inventory management, allocationplanning, order fulfilment, adjustment of manufacturing and inventorylevels at various stocking points and distribution centers, and/or oneor more related tasks within supply chain network 100.

One or more supply chain entities 160 represent one or more supply chainnetworks, such as, for example, one or more enterprises, and may includeone or more retailers, distribution centers, manufacturers, suppliers,customers, and/or the like. Retailers may comprise any online orbrick-and-mortar store that sells one or more products to one or morecustomers. Retailers may receive products from one or more distributioncenters. Distribution centers may be any suitable entity that offers tostore or otherwise distribute at least one product to one or moreretailers and/or customers. Distribution centers may, for example,receive a product from a first one or more supply chain entities 160 insupply chain network 100 and store and transport the product for asecond one or more supply chain entities 160. Manufacturers may be anysuitable entity that manufactures at least one product, which may besold by one or more retailers. Manufacturers may use one or more itemsduring the manufacturing process to produce any manufactured,fabricated, assembled, or otherwise processed item, material, component,good, or product. In one embodiment, a product represents an item readyto be supplied to, for example, one or more supply chain entities 160 insupply chain network 100, such as retailers, an item that needs furtherprocessing, or any other item. Suppliers may be any suitable entity thatoffers to sell or otherwise provides one or more items (i.e., materials,components, or products) to one or more manufacturers. Although one ormore supply chain entities 160 are described as separate and distinctentities, the same entity may simultaneously act as any one of the oneor more supply chain entities 160. For example, one or more supply chainentities 160 acting as a manufacturer can produce a product, and thesame one or more supply chain entities 160 can act as a supplier tosupply an item to itself or another one or more supply chain entities160. Although one example of a supply chain network 100 is shown anddescribed, embodiments contemplate any configuration of supply chainnetwork 100, without departing from the scope described herein.

In one embodiment, cyclic boosting system 110 may be coupled withnetwork 180 using communication link 190 a, which may be any wireline,wireless, or other link suitable to support data communications betweencyclic boosting system 110 and network 180 during operation of supplychain network 100. Archiving system 120 may be coupled with network 180using communication link 190 b, which may be any wireline, wireless, orother link suitable to support data communications between archivingsystem 120 and network 180 during operation of supply chain network 100.One or more planning and execution systems 130 may be coupled withnetwork 180 using communication link 190 c, which may be any wireline,wireless, or other link suitable to support data communications betweenone or more planning and execution systems 130 and network 180 duringoperation of supply chain network 100. Inventory system 140 may becoupled with network 180 using communication link 190 d, which may beany wireline, wireless, or other link suitable to support datacommunications between inventory system 140 and network 180 duringoperation of supply chain network 100. Transportation network 150 may becoupled with network 180 using communication link 190 e, which may beany wireline, wireless, or other link suitable to support datacommunications between transportation network 150 and network 180 duringoperation of supply chain network 100. One or more supply chain entities160 may be coupled with network 180 using communication link 190 f,which may be any wireline, wireless, or other link suitable to supportdata communications between one or more supply chain entities 160 andnetwork 180 during operation of supply chain network 100. Computer 170may be coupled with network 180 using communication link 190 g, whichmay be any wireline, wireless, or other link suitable to support datacommunications between computer 170 and network 180 during operation ofsupply chain network 100.

Although communication links 190 a-190 g are shown as generally couplingcyclic boosting system 110, archiving system 120, one or more planningand execution systems 130, inventory system 140, transportation network150, one or more supply chain entities 160, and computer 170 to network180, any of cyclic boosting system 110, archiving system 120, one ormore planning and execution systems 130, inventory system 140,transportation network 150, one or more supply chain entities 160, andcomputer 170 may communicate directly with each other, according toparticular needs.

In another embodiment, network 180 includes the Internet and anyappropriate local area networks (LANs), metropolitan area networks(MANs), or wide area networks (WANs) coupling cyclic boosting system110, archiving system 120, one or more planning and execution systems130, inventory system 140, transportation network 150, one or moresupply chain entities 160, and computer 170. For example, data may bemaintained locally to, or externally of, cyclic boosting system 110,archiving system 120, one or more planning and execution systems 130,inventory system 140, transportation network 150, one or more supplychain entities 160, and computer 170 and made available to one or moreassociated users of cyclic boosting system 110, archiving system 120,one or more planning and execution systems 130, inventory system 140,transportation network 150, one or more supply chain entities 160, andcomputer 170 using network 180 or in any other appropriate manner. Forexample, data may be maintained in a cloud database at one or morelocations external to cyclic boosting system 110, archiving system 120,one or more planning and execution systems 130, inventory system 140,transportation network 150, one or more supply chain entities 160, andcomputer 170 and made available to one or more associated users ofcyclic boosting system 110, archiving system 120, one or more planningand execution systems 130, inventory system 140, transportation network150, one or more supply chain entities 160, and computer 170 using thecloud or in any other appropriate manner. Those skilled in the art willrecognize that the complete structure and operation of network 180 andother components within supply chain network 100 are not depicted ordescribed. Embodiments may be employed in conjunction with knowncommunications networks and other components.

In accordance with the principles of embodiments described herein,cyclic boosting system 110 may generate demand forecasts for one or moreretailers of one or more supply chain entities 160. Based on theforecasted demand (or other retail volume) and the identification andcalculated factors of features, retailers accessing one or more planningand executions systems 130, inventory system 140, and/or transportationnetwork 150 may initiate an action to adjust inventory levels at variousstocking locations, production of products of manufacturing equipment,proportional or alternative sourcing of one or more supply chainentities 160, and the configuration and quantity of packaging andshipping of products and taking into account the current inventory orproduction levels at one or more supply chain entities 160. For example,methods described herein may include computer 170 receiving product data254 from automated machinery having at least one sensor and product data254 corresponding to an item detected by the automated machinery.Received product data 254 may include an image of the item, anidentifier, as described above, and/or other product data 254 associatedwith the item (dimensions, texture, estimated weight, and any other likedata). The method may further include computer 170 looking up receivedproduct data 254 in a database system associated with one or more supplychain planning and execution systems 130 to identify the itemcorresponding to product data 254 received from the automated machinery.

Computer 170 may also receive from the automated machinery, a currentlocation of the identified item. Based on the identification of theitem, computer 170 may also identify (or alternatively generate) a firstmapping in supply chain network 100, where the first mapping isassociated with the current location of the identified item. Computer170 may also identify a second mapping in supply chain network 100,where the second mapping is associated with a past location of theidentified item. Computer 170 may also compare the first mapping and thesecond mapping to determine if the current location of the identifieditem in the first mapping is different than the past location of theidentified item in the second mapping. Computer 170 may then sendinstructions to the automated machinery based, as least in part, on oneor more differences between the first mapping and the second mappingsuch as, for example, to locate items to add to or remove from aninventory of one or more supply chain entities.

Although the disclosed systems and methods are described below primarilyin connection with retail demand forecasting solely for the sake ofclarity, cyclic boosting is applicable to many other applications forpredicting a volume from a set of features along with the contributionsfrom each feature, including, for example, future stock and housingprices, insurance churn predictions, and drug discovery.

FIG. 2 illustrates cyclic boosting system 110, archiving system 120, andplanning and execution system 130 of FIG. 1 in more detail, inaccordance with an embodiment. Cyclic boosting system 110 may compriseserver 112 and database 114, as discussed above. Although cyclicboosting system 110 is shown as comprising a single server 112 and asingle database 114, embodiments contemplate any suitable number ofservers or databases internal to or externally coupled with cyclicboosting system 110.

Server 112 of cyclic boosting system 110 comprises data processingmodule 202, cyclic boosting model 204, training module 206, predictionmodule 208, and user interface module 210. Although server 112 is shownand described as comprising a single data processing module 202, asingle cyclic boosting model 204, a single training module 206, a singleprediction module 208, and a single user interface module 210,embodiments contemplate any suitable number or combination of theselocated at one or more locations, local to, or remote from cyclicboosting system 110, such as on multiple servers or computers at one ormore locations in supply chain network 100.

Database 114 of cyclic boosting system 110 may comprise one or moredatabases or other data storage arrangement at one or more locations,local to, or remote from, server 112. Database 114 of cyclic boostingsystem 110 comprises, for example, training data 220, model parameters222, trained models 224, current data 226, and predictions data 228.Although database 112 of cyclic boosting system 110 is shown anddescribed as comprising training data 220, model parameters 222, trainedmodels 224, current data 226, and predictions data 228, embodimentscontemplate any suitable number or combination of these, located at oneor more locations, local to, or remote from, cyclic boosting system 110according to particular needs.

In one embodiment, data processing module 202 of cyclic boosting system110 receives data from archiving system 120, supply chain planning andexecution systems 130, inventory system 140, transportation network 150,one or more supply chain entities 160, computer 170, or one or more datastorage locations local to, or remote from, supply chain network 100 andcyclic boosting system 110, and prepares the data for use in trainingcyclic boosting model 204 and generating predictions data 228 fromtrained models 224. Data processing module 202 prepares received datafor use in training and prediction by checking received data for errorsand transforming the received data. Data processing module 202 may checkreceived data for errors in the range, sign, and/or value and usestatistical analysis to check the quality or the correctness of thedata. According to embodiments, data processing module 202 transformsthe received data to normalize, aggregate, and/or rescale the data toallow direct comparison of received data from different planning andexecution systems 130.

Cyclic boosting model 204 comprises an untrained model used by trainingmodule 206 to generate trained models 224 by finding model parameters222. According to one embodiment, cyclic boosting model 204 is trainedfrom training data 220 to predict a volume Y (target or label) from aset of features X along with feature factors that describe the strengthof each feature variable contributing to the prediction.

Training module 206 uses training data 220 to train cyclic boostingmodel 204 by identifying model parameters 222 and generate trainedmodels 224. As described in more detail below, training module 206 usescyclic boosting model 204 to calculate factors of a set of features andother model parameters 222 from training data 220.

Prediction module 208 applies samples of current data 226 to trainedmodels 224 to generate predictions stored as predictions data 228. Asdescribed in more detail below, prediction module 208 predicts a volumeY (target or label) from a set of features X along with feature factorsthat describe the strength of each feature variable contributing to thepredicted volume. According to some embodiments, prediction module 208generates predictions at daily intervals. However, embodimentscontemplate longer and shorter prediction phases that may be performed,for example, weekly, twice a week, twice a day, hourly, or the like.

User interface module 210 of cyclic boosting system 110 generates anddisplays a user interface (UI), such as, for example, a graphical userinterface (GUI), that displays one or more interactive visualizations ofpredictions and the contribution from one or more features to theprediction. According to embodiments, user interface module 210 displaysa GUI comprising interactive graphical elements for selecting one ormore items, stores, or products and, in response to the selection,displaying one or more graphical elements identifying one or morefeatures and an importance of the retrieved one or more features to thedemand prediction. Further, user interface module 210 may displayinteractive graphical elements providing for modifying future states ofthe one or more identified features, and, in response to modifying theone or more future states of the features, modifying input values torepresent a future scenario corresponding to the modified futures statesof the one or more features. For example, embodiments of user interfacemodule 210 provide “what if” scenario modeling and prediction formodifying a future weather variable to identify and calculate the changein a prediction based on a change in weather using historical weatherdata and related historical supply chain data 232. For example, demandfor plywood changes dramatically when a hurricane is predicted to strikea particular region. To predict the influence of a hurricane on sales,cyclic boosting system 110 modifies input values to represent a futurescenario modeled by the “what if” scenario.

The various types of data stored in database 114 of cyclic boostingsystem 110 will now be discussed.

Training data 220 comprises a selection of one or more years ofhistorical supply chain data 232 aggregated or disaggregated at variouslevels of granularity and presented to the cyclic boosting model 204 togenerate trained models 224. According to one embodiment, training data220 comprises historic sales patterns, prices, promotions, weatherconditions, and other factors influencing future demand of a particularitem sold in a given store on a specific day. As described in moredetail below, cyclic boosting system 110 may receive training data 220from archiving system 120, one or supply chain planning and executionsystems 130, inventory system 140, transportation network 150, one ormore supply chain entities 160, computer 170, or one or more datastorage locations local to, or remote from, supply chain network 100 andcyclic boosting system 110.

Model parameters 222, such as, for example, factors and a globalaverage, are determined from training data 220 according to a fittingprocedure of cyclic coordinate descent with boosting-like update offactors.

Trained models 224 comprise cyclic boosting model 204 trained fromtraining data 220 to predict future retail quantities along with featurefactors that describe the strength of each feature variable contributingto the prediction. Current data 226 comprises data used to generate aprediction from trained models 224. According to embodiments, currentdata 226 comprises current sales patterns, prices, promotions, weatherconditions, and other current factors influencing demand of a particularitem sold in a given store on a specific day.

Predictions data 110 comprises a retail volume, such as, for example, asales volume, demand volume, and the like, as well as the contributionsfrom one or more features used by prediction module 216 to generated theretail volume. According to one embodiment, predictions data 228comprises a predicted volume Y (target or label) from a set of featuresX along with feature factors that describe the strength of each featurevariable contributing to the prediction. As described in more detailbelow, prediction data 220 comprises feature factors that describe thestrength of each feature variable contributing to each prediction.

As stated above, archiving system 120 comprises server 122 and database124. Although archiving system 120 is shown as comprising a singleserver 122 and a single database 124, embodiments contemplate anysuitable number of servers or databases internal to or externallycoupled with archiving system 120.

Server 122 of archiving system 120 comprises data retrieval module 230.Although server 122 is shown and described as comprising a single dataretrieval module 230, embodiments contemplate any suitable number orcombination of data retrieval modules 230 located at one or morelocations, local to, or remote from archiving system 120, such as onmultiple servers or computers at one or more locations in supply chainnetwork 100.

In one embodiment, data retrieval module 230 of archiving system 120receives historical supply chain data 232 from one or more supply chainplanning and execution systems 130, inventory system 140, transportationnetwork 140, and one or more supply chain entities 160 and stores thereceived historical supply chain data 232 at database 124. According toone embodiment, data retrieval module 230 may prepare historical supplychain data 232 for use as training data 220 of cyclic boosting system110 by checking historical supply chain data 232 for errors andtransforming historical supply chain data 232 to normalize, aggregate,and/or rescale historical supply chain data 232 to allow directcomparison of data received from different supply chain planning andexecution systems 130, inventory system 140, transportation network 150,one or more supply chain entities 160, and/or one or more otherlocations local to, or remote from, archiving system 120. According toembodiments, data retrieval module 230 receives data from one or moresources external to supply chain network 100, such as, for example,weather data, special events data, social media data, calendars, and thelike and stores the received data as historical supply chain data 232.

Database 124 of archiving system 120 may comprise one or more databasesor other data storage arrangement at one or more locations, local to, orremote from, server 122. Database 124 of archiving system 120 comprises,for example, historical supply chain data 232. Although database 124 ofarchiving system 120 is shown and described as comprising historicalsupply chain data 232, embodiments contemplate any suitable number orcombination of data, located at one or more locations, local to, orremote from, archiving system 120, according to particular needs.

Historical supply chain data 232 comprises historical data received fromcyclic boosting system 110, archiving system 120, one or more supplychain planning and execution systems 130, inventory system 140,transportation network 150, one or more supply chain entities 160,computer 170, and/or one or more locations local to, or remote from,supply chain network 100, such as, for example, weather data, specialevents data, social media data, calendars, and the like. Historicalsupply chain data 232 may comprise, for example, historic salespatterns, prices, promotions, weather conditions and other factorsinfluencing future demand of the number of one or more items sold in oneor more stores over a time period, such as, for example, one or moredays, weeks, months, years, including, for example, a day of the week, aday of the month, a day of the year, week of the month, week of theyear, month of the year, special events, paydays, and the like.

As stated above, planning and execution system 130 comprises server 132and database 134. Although planning and execution system 130 is shown ascomprising a single server 132 and a single database 134, embodimentscontemplate any suitable number of servers or databases internal to orexternally coupled with planning and execution system 130.

Server 132 of planning and execution system 130 comprises planningmodule 240 and prediction module 242. Although server 132 is shown anddescribed as comprising a single planning module 240 and a singleprediction module 242, embodiments contemplate any suitable number orcombination of planning modules and prediction modules located at one ormore locations, local to, or remote from planning and execution system130, such as on multiple servers or computers at one or more locationsin supply chain network 100.

Database 134 of planning and execution system 130 may comprise one ormore databases or other data storage arrangement at one or morelocations, local to, or remote from, server 132. Database 134 ofplanning and execution system 130 comprises, for example, transactiondata 250, supply chain data 252, product data 254, inventory data 256,inventory policies 258, store data 260, customer data 262, demandforecasts 264, supply chain models 266, and prediction models 268.Although database 134 of planning and execution system 130 is shown anddescribed as comprising transaction data 250, supply chain data 252,product data 254, inventory data 256, inventory policies 258, store data260, customer data 262, demand forecasts 264, supply chain models 266,and prediction models 268, embodiments contemplate any suitable numberor combination of data, located at one or more locations, local to, orremote from, supply chain planning and execution system 130, accordingto particular needs.

Planning module 240 of planning and execution system 130 works inconnection with prediction module 242 to generate a plan based on one ormore predicted retail volumes, classifications, or other predictions. Byway of example and not of limitation, planning module 240 may comprise ademand planner that generates a demand forecast for one or more supplychain entities 160. Planning module 240 may generate the demandforecast, at least in part, from predictions and calculated factorvalues for one or more features received from prediction module 242. Byway of a further example, planning module 240 may comprises anassortment planner and/or a segmentation planner that generates productassortments that match causal effects calculated for one or morecustomers or products by prediction module 240, which may provide forincreased customer satisfaction and sales, as well as reducing costs forshipping and stocking products at stores where they are unlikely tosell.

Prediction module 242 of planning and execution system 130 appliessamples of transaction data 250, supply chain data 252, product data254, inventory data 256, store data 260, customer data 262, demandforecasts 264, and other data to prediction models 268 to generatepredictions and calculated factor values for one or more features. Asstated above in connection with prediction module 208 of cyclic boostingsystem 110, prediction module 242 of planning and execution system 130predicts a volume Y (target or label) from a set of features X alongwith feature factors that describe the strength of each feature variablecontributing to the predicted volume. According to some embodiments,prediction module 242 generates predictions at daily intervals. However,embodiments contemplate longer and shorter prediction phases that may beperformed, for example, weekly, twice a week, twice a day, hourly, orthe like.

The various types of data stored in database 134 of planning andexecution system 130 will now be discussed.

Transaction data 250 may comprise recorded sales and returnstransactions and related data, including, for example, a transactionidentification, time and date stamp, channel identification (such asstores or online touchpoints), product identification, actual cost,selling price, sales volume, customer identification, promotions, and orthe like. In addition, transaction data 250 is represented by anysuitable combination of values and dimensions, aggregated orun-aggregated, such as, for example, sales per week, sales per week perlocation, sales per day, sales per day per season, or the like.

Supply chain data 252 may comprise any data of one or more supply chainentities 160 including, for example, item data, identifiers, metadata(comprising dimensions, hierarchies, levels, members, attributes,cluster information, and member attribute values), fact data (comprisingmeasure values for combinations of members), business constraints, goalsand objectives of one or more supply chain entities 160.

Product data 254 of database 114 may comprise products identified by,for example, a product identifier (such as a Stock Keeping Unit (SKU),Universal Product Code (UPC) or the like), and one or more attributesand attribute types associated with the product ID. Product data 254 maycomprise data about one or more products organized and sortable by, forexample, product attributes, attribute values, product identification,sales volume, demand forecast, or any stored category or dimension.Attributes of one or more products may be, for example, any categoricalcharacteristic or quality of a product, and an attribute value may be aspecific value or identity for the one or more products according to thecategorical characteristic or quality, including, for example, physicalparameters (such as, for example, size, weight, dimensions, color, andthe like).

Inventory data 256 of database 114 may comprise any data relating tocurrent or projected inventory quantities or states, order rules, or thelike. For example, inventory data 256 may comprise the current level ofinventory for each item at one or more stocking points across supplychain network 100. In addition, inventory data 256 may comprise orderrules that describe one or more rules or limits on setting an inventorypolicy, including, but not limited to, a minimum order volume, a maximumorder volume, a discount, and a step-size order volume, and batchquantity rules. According to some embodiments, planning and executionssystem 130 accesses and stores inventory data 256 in database 114, whichmay be used by planning and execution system 130 to place orders, setinventory levels at one or more stocking points, initiate manufacturingof one or more components, or the like in response to, and based atleast in part on, a forecasted demand of cyclic boosting system 110. Inaddition, or as an alternative, inventory data 256 may be updated byreceiving current item quantities, mappings, or locations from inventorysystem 140 and/or transportation network 150.

Inventory policies 258 of database 134 may comprise any suitableinventory policy describing the reorder point and target quantity, orother inventory policy parameters that set rules for cyclic boostingsystem 110 and/or planning and execution system 130 to manage andreorder inventory. Inventory policies 258 may be based on target servicelevel, demand, cost, fill rate, or the like. According to embodiment,inventory policies 258 comprise target service levels that ensure that aservice level of one or more supply chain entities 160 is met with acertain probability. For example, one or more supply chain entities 160may set a service level at 95%, meaning supply chain entities 160 willset the desired inventory stock level at a level that meets demand 95%of the time. Although, a particular service level target and percentageis described; embodiments contemplate any service target or level, forexample, a service level of approximately 99% through 90%, a 75% servicelevel, or any suitable service level, according to particular needs.Other types of service levels associated with inventory quantity ororder quantity may comprise, but are not limited to, a maximum expectedbacklog and a fulfillment level. Once the service level is set, cyclicboosting system 110 and/or planning and execution system 130 maydetermine a replenishment order according to one or more replenishmentrules, which, among other things, indicates to one or more supply chainentities 160 to determine or receive inventory to replace the depletedinventory. By way of example and not of limitation, an inventory policyfor non-perishable goods with linear holding and shorting costscomprises a min./max. (s,S) inventory policy. Other inventory policiesmay be used for perishable goods, such as fruit, vegetables, dairy,fresh meat, as well as electronics, fashion, and similar items for whichdemand drops significantly after a next generation of electronic devicesor a new season of fashion is released.

Store data 260 may comprise data describing the stores of one or moreretailers and related store information. Store data 260 may comprise,for example, a store ID, store description, store location details,store location climate, store type, store opening date, lifestyle, storearea (expressed in, for example, square feet, square meters, or othersuitable measurement), latitude, longitude, and other similar data.

Customer data 262 may comprise customer identity information, including,for example, customer relationship management data, loyalty programs,and mappings between product purchases and one or more customers so thata customer associated with a transaction may be identified. Customerdata 262 may comprise data relating customer purchases to one or moreproducts, geographical regions, store locations, or other types ofdimensions.

Demand forecasts 264 of database 114 may indicate future expected demandbased on, for example, any data relating to past sales, past demand,purchase data, promotions, events, or the like of one or more supplychain entities 180. Demand forecasts 264 may cover a time interval suchas, for example, by the minute, hour, daily, weekly, monthly, quarterly,yearly, or any suitable time interval, including substantially in realtime. Demand may be modeled as a negative binomial or Poisson-Gammadistribution. However, the model must also take into account shelf-lifeof perishable goods (which may range from days (e.g. fresh fish or meat)to weeks (e.g. butter) or even months, before any unsold items have tobe written off as waste) as well as influences from promotions, pricechanges, rebates, coupons, and even cannibalization effects within anassortment range. In addition, customer behavior is not uniform butvaries throughout the week and is influenced by seasonal effects and thelocal weather, as well as many other contributing factors. Accordingly,even when demand generally follows a Poisson-Gamma model, the exactvalues of the parameters of this model are specific to a single productto be sold on a specific day in a specific location or sales channel anddepends on a wide range of frequently changing influencing factors. Byway of example and not by way of limitation, an exemplary supermarketmay stock twenty-thousand items at one thousand locations. If eachlocation of this exemplary supermarket is open every day of the year,planning and execution system 130 comprising a demand planner would needto calculate approximately 2×10{circumflex over ( )}10 demand forecastseach day to derive the optimal order volume for the next delivery cycle(e.g. three days).

Supply chain models 266 comprise characteristics of a supply chain setupto deliver the customer expectations of a particular customer businessmodel. These characteristics may comprise differentiating factors, suchas, for example, MTO (Make-to-Order), ETO (Engineer-to-Order) or MTS(Make-to-Stock). However, supply chain models 230 may also comprisecharacteristics that specify the supply chain structure in even moredetail, including, for example, specifying the type of collaborationwith the customer (e.g. Vendor-Managed Inventory (VMI)), from whereproducts may be sourced, and how products may be allocated, shipped, orpaid for, by particular customers. Each of these characteristics maylead to a different supply chain model. Prediction models 268 compriseone or more of trained models 224 used by planning and execution system130 for predicting a retail volume, such as, for example, a forecasteddemand volume for one or more items at one or more stores of one or moreretailers.

FIG. 3 illustrates method 300 of cyclic boosting, in accordance with anembodiment. Method 300 proceeds by one or more activities, whichalthough described in a particular order, may be performed in one ormore permutations, according to particular needs. Method 300 of cyclicboosting provides for efficiently calculating all relevant parameters tomodel the demand of individual products, taking a wide range ofinfluencing factors into account while providing insight into how eachindividual prediction was made.

According to an embodiment, method 300 begins at activity 302 wherecyclic boosting system 110 receives a list of input variables, inputvariable definitions, and an input variable sequence. The structure ofcyclic boosting model 204 provides for the modeling of hierarchicalcausal dependencies in the data by choosing an appropriate featuresequence. Continuing with the exemplary retail sales volume predictiondescribed above, an example for this would be a feature that affects allitems in a store in a similar way, like day of the week, followed by afeature that affects different items differently, like special weatherconditions. Furthermore, cyclic boosting model 204 additionally providesfor building models with several stages of separate cyclic boostingestimators by using the results of earlier stages as prior predictionsfor later ones in a Bayesian sense, as described in more detail below.By way of example and not by way of limitation, one or more retailersmay predict a future demand volume Y (which may be referred to as atarget or label) from a set of features X using cyclic boosting system110 to estimate the conditional p(Y|X) of the joint probability densitydistribution p(Y, X) when the values z of the feature variables X areobserved.

According to embodiments, user interface module 210 provides a list ofsample input variables, sample input variable definitions, and sampleinput variable sequences, which may be selected by a user on a userinterface visualization. In addition, embodiments of user interfacemodule 210 may provide a visualization comprising graphical elementsthat provide selection or input of an item-store-day combination (orother demand forecasting unit with a time dimension (DFU-time)). Inresponse to selection or input of a DFU-time, cyclic boosting system 110calculates or retrieves the factors affecting a demand forecast or otherprediction of the DFU-time.

At activity 304, cyclic boosting system 110 bins continuous features.Cyclic boosting system 110 bins each feature X_(j), wherein categoricalfeatures retain their original categories, while continuous features arediscretized such that each bin has the same width (equidistant binning)or contains approximately the same quantity of observations.

At activity 306, cyclic boosting system 110 trains a prediction modelusing cyclic boosting. The training action comprises training thesupervised machine learning model, wherein each bin of each feature isconsidered, in turn, and an appropriate modification to the prediction Ŷof the target Y is calculated. Cyclic boosting system 110 selects anoperational mode based, at least in part, on the range of the target Y.In method 300 of cyclic boosting, each feature X_(j) from X=(X₁, X₂, . .. , X_(p)) contributes in a specific way to the prediction of a targetŶ. If all contributions are calculated on a granular level, eachprediction ŷ_(i) for a given observation i is transparently interpretedby analyzing, for the observed values x_(j,i), how much each featureX_(j) contributes to the prediction. As described in more detail herein,cyclic boosting system 110 selects a multiplicative regression mode whenthe range of target predictions is restricted to positive numbers (i.e.Y ∈[0, ∞)) (such as, for example, demand forecasts; Poisson distributionhaving natural log link function); selects a additive regression modewhen the range of target predictions range from negative to positiveinfinity (i.e. Y ∈(−∞, ∞)) (such as, for example, targeting effects;Gaussian distribution having an identity link function); and selects aclassification mode when the range of targets comprises a binaryclassification (i.e. Y ∈[0, 1]) (such as, for example, binarycategorization; Bernoulli distribution having a logit link function).

When cyclic boosting system 110 detects one or more stopping criteria,cyclic boosting system 110 ends the training process and generates atrained model at activity 308. By way of example and not of limitation,stopping criteria may comprise a maximum number of iterations or nofurther improvement of an error metric (e.g. the mean absolute deviation(MAD) or mean squared error (MSE)). As stated above, trained models 224may be used for future predictions and identifying the strength of eachfeature's influence on an individual prediction.

At activity 310, cyclic boosting system 110 predicts a target variable.A prediction process may comprise, for example, forecasting futureconsumer demand, predicting the effect of a price change, determiningwhether an event will occur at a particular future time period, and thelike. As described in further detail below, cyclic boosting system 110uses trained models 224 to calculate predictions and communicates thepredictions with an explanation of the strength of each factorinfluencing the prediction. By way of example only and not oflimitation, the multiplicative regression mode is used, for example,when predicting sales of an item in a supermarket. Because sales volumecannot be negative (assuming returns are excluded), the targets of salesin a supermarket for a specific item ranges from zero to infinity. Thetarget is restricted from zero to positive infinity, the targetdistribution takes the form of a Poisson or Poisson-Gamma distribution,and method 300 of cyclic boosting performs the multiplicative regressionmode, as explained in greater detail below.

However, for predicting interventional effects or binary categorization,the range of the targets Y are different and method 300 of cyclicboosting uses different operational modes. An interventional effect caninclude prediction targets that are positive or negative. For example,predicting the increase or decrease in demand for an item based on anincrease or decrease in price change is an interventional effect. Thetargets Y range from negative to positive infinity in a Gaussiandistribution, and method 300 of cyclic boosting uses the additiveregression mode. In embodiments of method 300 of cyclic boosting thatpredict binary categorization, such as, for example, predicting whetheran event will happen, the range of targets Y comprise a choice betweentwo options, such as, for example, the numbers “one” and “zero”, whereina value of one represents “affirmative” “yes” “an event will occur” orthe like, and wherein a value of zero represents “negative” “no” “anevent will not occur” or the like. Each mode of the cycling boostingmethod 300 (e.g. multiplicative regression mode, additive regressionmode, categorization mode) is described in greater detail, below.

Owing to its straightforward structure based on fundamental arithmeticoperations, cyclic boosting system 110 and method 300 improve the speedof accurate demand forecasting and provide for training efficiently on alarge amount of data as well as parallelization of training andprediction.

Multiplicative Regression Mode

The multiplicative regression mode of method 300 of cyclic boosting willnow be described in detail, in accordance with an embodiment.Modifications to multiplicative regression mode to form the additiveregression mode and classification mode are described in greater detailbelow.

As stated above, cyclic boosting system 110 uses the multiplicativeregression mode of method 300 of cyclic boosting when the target is anon-negative number (i.e. Y ∈[0, ∞). According to embodiments, cyclicboosting system 110 calculates the predicted value ŷ_(i) of the targetvariable, given the observation {right arrow over (x_(l))} of a set offeature variables X according to Equation 1.

$\begin{matrix}{{\hat{y}}_{i} = {{\mu \cdot {\overset{p}{\prod\limits_{j = 1}}{f_{j}^{k}{with}k}}} = \left\{ {x_{j,i} \in b_{j}^{k}} \right\}}} & (1)\end{matrix}$

where, f_(j) ^(k) are the factors for each feature j and bin k. For anyconcrete observation i, cyclic boosting system 110 determines the indexk of the bin by the observation of x_(j,i) and, subsequently, looking-upthe bin into which this observation falls. Cyclic boosting system 110calculates the global average from all observed target values y takenacross all of training data 220. With the assumption that the targetvariable Y is generated as the mean of a Poisson distribution, the linkfunction g is the logarithm ln, and Equation 1 may be inferred from thestructure of a generalized additive model by applying g⁻¹.

FIG. 4 illustrates method 400 of calculating model parameters 222 ofcyclic boosting model 204, in accordance with an embodiment. Inaccordance with the following method 400, cyclic boosting system 110calculates the model parameters 222 comprising factors f_(j) ^(k) andthe global average from all observed target values y taken across all oftraining data 220.

At activity 402, cyclic boosting system 110 calculates the globalaverage μ from all observed target values y across all bins k andfeatures j, where bins are denoted by b_(j) ^(k), i.e. bin k=1, . . . ,n, for feature X_(j). Continuing with the example of predicting demandfor a particular retail item, at a particular store, on a given day,features may comprise store, item, day of the week, day of the year,month, and combinations of the foregoing such as, for example,store-trend, item-store, week of month-month, week of month-store, dayof week-store, day of week-item, store-month, item-month, and the like.Continuing with the example of a forecasting demand, cyclic boostingsystem 110 calculates the global average of the observed demand for eachbin and feature from training data 220.

At activity 404, cyclic boosting system 110 initializes the factors to1: (i.e. f_(j) ^(k)←1). Cyclic boosting system 110 sets all factors(i.e. all bins in all features) to 1 and continues to activity 406.

At activity 406, cyclic boosting system 110 cyclically iterates throughfeatures j=1, . . . , p and calculates, in turn, for each bin k, thepartial factors g and corresponding aggregated factors f, according toEquations 2 and 3.

$\begin{matrix}{g_{j,t}^{k} = \frac{\sum\limits_{x_{j,i} \in b_{j}^{k}}y_{i}}{\sum\limits_{x_{j,i} \in b_{j}^{k}}{\hat{y}}_{i,\tau}}} & (2)\end{matrix}$

where index t represents a current iteration, index τ represents acurrent or a preceding iteration, and both indices refer to iterationsof full feature cycles, as the training of cyclic boosting model 204progresses. According to this embodiment, a full feature cycle refers tocyclic boosting system 110 calculating updated values for all features(j=1, . . . , p), as distinguished from a partial iteration, whereincyclic boosting system 110 has calculated updated values of less thanall of the features. Cyclic boosting system 110 multiplies the partialfactor g with aggregated factor f_(t-1) in each iteration, andcalculates the predicted value ŷ_(τ) of the target variable for thecurrent iteration according to Equation 1 with the current values of theaggregated factors f as shown in Equation 4.

$\begin{matrix}{{\hat{y}}_{i,\tau} = {\mu \cdot {\overset{p}{\prod\limits_{j = 1}}f_{j,\tau}^{k}}}} & (4)\end{matrix}$

Cyclic boosting system 110 determines g_(j,t) ^(k) for a feature j byemploying f_(j,t-1) ^(k) when calculating the predicted value ŷ of thetarget variable. For the factors of all other features, the newestavailable values are used. According to embodiments, the newestavailable values for the factors of the other features may comprise thevalue from either the current (τ=t) or the preceding iteration (τ=t−1),depending on the sequence of features.

At activity 408, cyclic boosting system 110 checks for one or morestopping criteria at the end of a full feature cycle. When no stoppingcriteria are detected at the end of a full feature cycle, cyclicboosting system 110 returns to activity 406 and iterates through one ormore additional full feature cycles. When cyclic boosting system 110detects one or more stopping criteria at activity 408 at the end of afull feature cycle, method 400 of calculating model parameters 222 ofcyclic boosting model 204 ends. As discussed above, stopping criteriamay comprise reaching a predetermined MAD or MSE or iterating apredetermined number of iterations.

By way of further example and not of limitation, when the predictionvalues y follow a Poisson distribution and corresponds to optimizing

$\chi^{2} = {\sum_{i}\frac{\left( {{y_{i}/{\hat{y}}_{i,\tau}} - g_{j}^{k}} \right)^{2}}{\sigma_{i}^{2}}}$

with σ_(i) ²=y_(i)/ŷ_(i,τ) for all observations i in each bin k offeature j. Because cyclic boosting system 110 considers each bin of eachfeature variable cyclically, but independently of each other, theoptimization is performed locally in each bin b_(j) ^(k), which mayprovide for improving the learning of rare observations by cyclicboosting model 204. While other approaches to machine learning mayover-regularize these effects, especially when far from the bulk of therespective distribution of observed feature variables X_(j), choosing asuitable binning treats rare observations separately from the bulk ofthe distribution of observed feature. As discussed below, regularizationmethods provide for avoiding learning wrong or spurious relationshipsfrom potentially low numbers of observations in bins.

Method 300 of cyclic boosting intrinsically supports the modeling ofhierarchical causal dependencies in the data. Continuing with theexemplary retail case discussed above, an example of causal dependenciesmay be a feature that affects all items in a store in a similar way,like day of the week, followed by a feature that has different effectson different items, like special weather conditions. Method 300 ofcyclic boosting method provides for building models with several stagesof separate cyclic boosting estimators by using the results of earlierstages as prior predictions for later ones in a Bayesian sense.Embodiments contemplate cyclic boosting estimators having any number ofstages providing predictions to any number of later stages, according toparticular needs. Although the cyclic consideration of all variablesalready accounts for correlations between the different features, thelearning of correlations between specific features may be furtherimproved by adding composed features with multidimensional binnings,e.g. built out of two or three of the original features.

Regularization and Smoothing

According to embodiments, cyclic boosting system 110 uses one or moreregularization methods to overcome numerical instabilities and reducethe risk of overfitting. As described in more detail below, one or moreregularization methods comprise, for example, Bayesian updates,smoothing, a learning rate, and sample weights, as described in greaterdetail below.

1. Bayesian Updates

Cyclic boosting system 110 iteratively updates factors f_(j) ^(k)according to Equation 2 and Equation 3, where the update rule has theform g=α/β. Because the Gamma distribution is the maximum entropyprobability distribution for a random variable ξ, for which E[ξ]=α/β isfixed and greater zero, the Gamma distribution is assumed as a prior forthe distribution of factors f_(j) ^(k) in each bin k of feature j.Furthermore, the numerator and denominator of Equation 2 have the formof the maximum likelihood estimator for an independent and identicallydistributed random variable following a Poisson or Poisson-Gammadistribution. These considerations motivate the description of theindividual contributions, i.e. the factors, to the prediction of atarget variable Y ∈[0, ∞) as conjugate distributions, the Gammadistribution being the conjugate prior to the Poisson likelihood.Equation 2 may be modified as shown in Equations 5-7.

$\begin{matrix}{g_{j}^{k} = \frac{\alpha_{j}^{k}}{\beta_{j}^{k}}} & (5)\end{matrix}$ with $\begin{matrix}{\alpha_{j}^{k} = {\alpha_{prior} + {\sum\limits_{x_{j,i} \in b_{j}^{k}}y_{i}}}} & (6)\end{matrix}$ $\begin{matrix}{\beta_{j}^{k} = {\beta_{prior} + {\sum\limits_{x_{j,i} \in b_{j}^{k}}{\hat{y}}_{i}}}} & (7)\end{matrix}$

The numerical values of the parameters of the prior Gamma distributionare chosen such that the median of the Gamma distribution is 1, i.e.α_(prior)=2, β_(prior)=1.67834. The definition of the factors inEquation 5 exploits the fact that the mean of the Gamma distribution maybe expressed as E[ξ]=α/β. According to embodiments, the median may beused as generally a more robust point estimator and not as sensitive tooutliers as the mean.

2. Smoothing

Cyclic boosting system 110 regularizes the factors f_(j) ^(k) acrossbins k for each feature j to improve the numerical stability of cyclicboosting model 204 during training. For categorical features, cyclicboosting system 110 regularizes factors in each category by determiningappropriate Bayesian a priori probabilities for each occurrence of thespecific category of feature variable X_(j). For continuous features,cyclical boosting system 110 applies smoothing functions, such as, forexample, splines or a suitable base of orthogonal polynomials.

Before smoothing the factors, cyclic boosting system 110 transforms therange of the factors from (0, ∞) to (−∞, ∞). According to someembodiments, cyclic boosting system 110 calculates the logarithm of thefactors, i.e. f′^(k) _(j)=ln(f_(j) ^(k)). To fit a smoothing function tothe factors, cyclic boosting system 110 estimates the uncertaintiesσ_(f′) _(j) _(k) of each factor f′ in each bin k for feature j frommoment matching of the Gamma distribution to the log-normal distribution(i.e. assuming that the uncertainties follow a Gaussian distributionafter cyclic boosting system 110 applies the logarithmictransformation). The variance of the Gamma distribution may then be setequal to the variance of the log-normal distribution according toEquation 8.

$\begin{matrix}{\frac{\alpha}{\beta^{2}} = {\left( {e^{\sigma^{2}} - 1} \right) \cdot e^{2{({\mu + \frac{\sigma^{2}}{2}})}}}} & (8)\end{matrix}$

The mean of the log-normal distribution is then substituted by the meanof the Gamma distribution according to Equation 9.

$\begin{matrix}{e^{\mu + \frac{\sigma^{2}}{2}} = \frac{\alpha}{\beta}} & (9)\end{matrix}$

Cyclic boosting system 110 then calculates the uncertainties accordingto Equation 10.

$\begin{matrix}{\sigma_{f_{j}^{\prime k}}^{2} = {{\log\left( {1 + \alpha_{j}^{k}} \right)} - {\log\left( \alpha_{j}^{k} \right)}}} & (10)\end{matrix}$

After smoothing, cyclic boosting system 110 transforms the factors backto the original range (i.e. (—∞, ∞)→(0, ∞)) by applying the exponentialfunction as the inverse of the natural logarithm.

3. Learning Rate

Additionally, or in the alternative, cyclic boosting system 110calculates factors using a learning rate to reduce dependency on thesequence of features. According to an embodiment, cyclic boosting system110 includes learning rate η in the calculation of the factors f (asshown in Equation 2) according to Equation 11.

ln({tilde over (g)} _(j,t) ^(k))=η_(t)·ln(g _(j,t) ^(k)) whereη_(t)∈(0,1]  (11)

where, the learning rate η is a small value at the beginning of thetraining (t=1) and increases after each full feature cycle t accordingto a linear or logistic function until the learning rate reaches η=1 forthe maximal number of iterations, hence {tilde over (g)}_(j) ^(k)→g_(j)^(k) as the cyclic boosting model 204 converges.

4. Sample Weights

As described in more detail below, cyclic boosting system 110 may usesample weights (and negative sample weights) to, for example, alterpredictions to account for temporal changes in time series data andidentify effects of observations that vary between groups. The binnedfeature-wise optimization of method 300 of cyclic boosting enablesintroduction of sample weights. By way of example only and not oflimitation, cyclic boosting system 110 may use sample weights toemphasize the most recent past when predicting a target available astimes series data. According to embodiments, this provides for improvingthe forecast quality in the presence of trends or other temporal changesin the data. By way of a further example and not of limitation,embodiments of cyclic boosting system 110 use sample weights forstatistical background subtraction.

According to embodiments, estimating the influence of a causal effect onrandomized groups represented in a sample of training data 220 may beimproved by statistical background subtraction. Using negative sampleweights with method 300 of cyclic boosting, cyclic boosting system 110generates a prediction of the causal effect of various influences onrandomized A/B groups present in training data 220, such as, forexample, the effect of coupon offerings on gross margin per customer. Byway of a more specific example, cyclic boosting system 110 may employ astatistical background subtraction in an A/B testing scenario to learneffects that exist for some of the observations in group A but do notexist in group B, assuming that groups A and B otherwise share the samecharacteristics. By taking into account correlations between featuresand a target variable, embodiments of cyclic boosting system 110 maydirectly predict causal effects for pure prediction tasks. For example,cyclic boosting system may make customer targeting decisions usingsample weights for statistical background subtraction. A customertargeting decision may comprise, for example, only making couponofferings to customers with a positive gross margin target, whereinpeople in group A get offered a discount, such as, for example, via acoupon offering, and people in group B do not. Optionally, embodimentscontemplate additional methods comprising an application of anindependence weight as an alternative to randomization.

Additive Regression Mode

As stated above, cyclic boosting system 110 performs method 300 ofcyclic boosting according to the additive regression mode when the rangeof the target variable is Y E (−∞, ∞). For the additive regression mode,Equations 1-3 are modified as shown in Equations 12-14.

$\begin{matrix}\begin{matrix}{{\hat{y}}_{i} = {\mu + {\overset{p}{\sum\limits_{j = 1}}f_{j}^{k}}}} & {{{with}k} = \left\{ {x_{j,i} \in b_{j}^{k}} \right\}}\end{matrix} & (12)\end{matrix}$

The conjugate distributions for the individual contributions to theprediction (in this case, the summands) follow a Gaussian function.Accordingly, cyclic boosting system 110 smooths the factors withouttransformation.

Classification Mode

The classification mode of method 300 of cyclic boosting will now bedescribed in greater detail in accordance with an embodiment.Classification mode of method 300 of cyclic boosting identifies whethera given observation i belongs to a certain class. The range of thetarget variable is in [0, 1], which may be interpreted as theprobability p_(i) that this observation belongs to the class (e.g.p_(i)→1) or does not belong to the class (e.g. p_(i)→0). According toembodiments, a suitable cut-off is selected and defined which separatesthe two cases.

Because the odds (represented by the ratio

$\left. \frac{p_{i}}{1 - p_{i}} \right)$

has the range [0, ∞), cyclic boosting system 110 may employ a similarapproach as the multiplicative regression mode, as shown in Equation 15.

$\begin{matrix}\begin{matrix}{\frac{{\hat{p}}_{i}}{1 - {\hat{p}}_{i}} = {\mu \cdot {\overset{p}{\prod\limits_{j = 1}}f_{j}^{k}}}} & {{{with}k} = \left\{ {x_{j,i} \in b_{j}^{k}} \right\}}\end{matrix} & (15)\end{matrix}$

Instead of a Gamma function, the conjugate prior for the factors is nowa Beta function, due to the binary nature of the setting, and thecorresponding likelihood is a Bernoulli function. Choosingα_(pior)=1.001 and β_(pior)=1.001, results in a uniform Betadistribution for the prior that drops sharply to zero at either end ofthe interval [0, 1], which is helpful to avoid overconfidence withextreme predictions. Cyclic boosting system 110 may then calculate theparameters of the posterior Beta distribution according Equations 16 and17.

$\begin{matrix}{\alpha_{j}^{k} = {\alpha_{prior} + {\sum\limits_{x_{j,i} \in b_{j}^{k}}y_{i}}}} & (16)\end{matrix}$ $\begin{matrix}{\beta_{j}^{k} = {\beta_{prior} + {\sum\limits_{x_{j,i} \in b_{j}^{k}}1} - y_{i}}} & (17)\end{matrix}$

Cyclic boosting system 110 estimates the factors and theiruncertainties, in turn, from the mean (or median) and variance of thisBeta distribution, similar to the approach taken for the multiplicativeregression mode, as described above.

Additionally, or in the alternative, cyclic boosting system 110 improvesthe performance of method 300 of cyclic boosting by including sampleweights according to the following Scheme 18.

$\begin{matrix}{w_{i} = \left\{ \begin{matrix}{{1 - {\hat{p}}_{i}},} & {{{if}y_{i}} = 1} \\{{\hat{p}}_{i},} & {{{if}y_{i}} = 0}\end{matrix} \right.} & (18)\end{matrix}$

According to embodiments, the definition of Scheme 18 enforces thetraining process to put more emphasis on observations that have beenmisclassified in the current state as shown in Equations 19 and 20.

$\begin{matrix}{\alpha_{j}^{k} = {\alpha_{prior} + \frac{\sum\limits_{x_{j,i} \in b_{j}^{k}}{w_{i} \cdot y_{i}}}{\sum\limits_{x_{j,i} \in b_{j}^{k}}w_{i}}}} & (19)\end{matrix}$ $\begin{matrix}{\beta_{j}^{k} = {\beta_{prior} + \frac{\sum\limits_{x_{j,i} \in b_{j}^{k}}{w_{i} \cdot \left( {1 - y_{i}} \right)}}{\sum\limits_{x_{j,i} \in b_{j}^{k}}w_{i}}}} & (20)\end{matrix}$

Similar to the multiplicative regression mode discussed above, cyclicboosting system 110 uses the logarithm to transform the range (0, ∞) to(−∞, ∞). In addition, cyclic boosting system 110 may perform actions ofregularization and smoothing, as described above.

Example 1

By way of explanation and not of limitation, an example ofmultiplicative regression mode of method 300 of cyclic boosting methodis described in connection with forecasting future demand of individualproducts sold in a retail location. In this example, historical supplychain data 232 comprises five years of historical data, from January of2013 until December of 2017, for 10 different stores and 50 differentitems, having the fields date, store, item, and sales, with sales beingthe target to predict. Additional features include features describingtrend and seasonality, namely, days since beginning of 2013 as a lineartrend as well as day of week, day of year, month, and week of month. Asdescribed in more detail below, the list of one- and two-dimensionalfeatures comprise: store, store-trend, item, item-store, day of theweek, day of the year, month, week of the month-month, week of themonth-store, day of the week-store, day of the week-item, store-month,and item-month. Here, two-dimensional features including the variable“item” (i.e. item-store, day of the week-item, and item-month) describecharacteristics of time series of individual products.

FIG. 5 illustrates chart 500 of smoothed factors 502, predictions 504,and observed values (truth) 506 for the feature variable “item” after afinal iteration, in accordance with an embodiment. Chart 500 indicatesthe behavior of predictions 504 and observed values 506 agree across therange of all fifty items. Predictions 504 are hardly visible due to goodagreement with observed values 506.

FIG. 6 illustrates chart 600 of smoothed factors 502, predictions 504,and observed values (truth 506) for the feature variable “day of theweek” after a final iteration, in accordance with an embodiment. Chart600 indicates the behavior of predictions 504 and observed values 506agree across the range of all seven days of the week. Similarly toabove, predictions 504 are hardly visible due to good agreement withobserved values 506.

Charts 500 and 600 illustrate mean values of the prediction aftercompletion of the training as well as the observed, true values in eachbin divided by the global mean of the factors for the feature variables“item” and “dayofweek”. A visualization comprising charts 500 and 600indicates possible deviations from the optimal fit results in thedifferent bins. According to the illustrated example, no significantdeviations for the feature variables “item” and “dayofweek” are presentacross the whole range of values. Furthermore, the smoothed values ofthe factor (e.g. fitted model parameters 222 of trained models 224)differ from the mean values of the target and prediction in thedifferent bins divided by the global mean due based on correlations withother features.

FIGS. 7A-7D illustrates visualizations 702-708 comprising an exemplarytwo-dimensional feature, in accordance with an embodiment.Visualizations 702-708 illustrate results of the combination of thefeatures “store” and “trend” (“td”) into a two-dimensional feature,after a final iteration. Visualization 702 comprises a binned,two-dimensional, color-coded or shaded visualization of the deviationsbetween final predictions and truth. Visualization 704 comprises thesmoothed values of the two-dimensional factors, again visualized bymeans of color-coding or shading. In the illustrated embodiment, one ofthe features is categorical (“store”) and the other one continuous(“td”), and the two-dimensional smoothing is performed by grouping bythe categorical feature dimension and smoothing the continuous one. Analternative for a two-dimensional smoothing in case of two continuousfeatures consists in performing a truncated singular-valuedecomposition. Visualizations 706-708 comprise two correspondingmarginal smoothed factor distributions 710 for the mean of therespective other dimension and its individual categories as well as themarginal distributions for final predictions 712 and observed values714. Predictions 712 are hardly visible due to good agreement withobserved values 714.

FIG. 8 illustrates a quadratic loss function visualization 800, inaccordance with an embodiment. According to the illustrated embodiment,quadratic loss function 802 quickly converges during prediction modeltraining and, cyclic boosting system 110 terminates training after t=8cycles.

FIG. 9 illustrates profile histogram visualization 900, in accordancewith an embodiment. Profile histogram visualization 900 comprises thepredictions for individual observations estimated by method 300 ofcyclic boosting compared with a corresponding true target, in accordancewith an embodiment. Profile histogram visualization 900 comprises meanpredictions compared with true values for individual observations acrossthe range predictions. On average, an unbiased estimator is expected toreproduce the true target subject to statistical fluctuations 902.Accordingly, a mean of a prediction of an individual observation shouldbe centered on the diagonal within the statistical fluctuations 902 (asindicated by asymmetric error bars). According to the illustratedembodiment, profile histogram visualization 900 indicates thepredictions evaluated by method 300 of cyclic boosting are unbiasedacross the whole range of target values.

According to embodiments, cyclic boosting system 110 generatesvisualizations that categorize, rank, and evaluate one or more featuresof a cyclic boosting prediction, such as the demand forecast, describedabove, and exemplary housing data observations, described below, whichuser interface module 210 may then render for display on output device174.

FIG. 10 illustrates features contribution visualization 1000, inaccordance with a first embodiment. Features contribution visualization1000 comprises a visualization of three exemplary sales predictions1002-1006 and contributions from predictive features 1010-1034 to eachof three exemplary sales predictions 1002-1006. According to embodimentscomprising a cyclic boosting model trained by historical sales data,cyclic boosting system 110 identifies the contribution of predictivefeatures 1010-1034, which are data or data features associated with anincreased or decreased sales prediction. Feature factor value 1008indicates the value of the factor of each predictive features 1010-1034for each sales prediction 1002-1006. A feature factor value 1008 equalto one (i.e. f_(j) ^(k)=1) indicates that the corresponding predictivefeature 1010-1034 had a neutral effect on predicted sales compared withthe other predictive features 1010-1034 and the more feature factorvalue 1008 deviates from one (i.e. neutral), the greater thecontribution of feature 1010-1034 to prediction 1002-1006. When featurefactor value 1008 has a value not equal to one (i.e. f_(j) ^(k)≠1), theimportance of its corresponding predictive feature 1010-1034 correspondsto the strength of the deviation, such that the greater the featurefactor value 1008 deviates from neutral (i.e. 1), the larger theimportance of a corresponding predictive feature 1010-1034 compared withother predictive feature 1010-1034.

Continuing with this example, predictive features 1010-1034 comprisestore 1010, store-trend (store-td) 1012, item 1014, item-store 1016, dayof week 1018, day of year 1020, month 1022, week of month-month 1024,week of month-store 1026, day of week-store 1028, day of week-item 1030,store-month 1032, and item-month 1034. As seen in connection with firstprediction 1002, item predictive feature 1014 and month predictivefeature 1022 both have a significant impact on the predicted salesvolume, which is indicated by feature factor values 1008 thatsignificantly deviate from neutral. In addition, the predictive featurecomprising a two-dimensional combination of item and month, representedby item-month predictive feature 1034, has the second largest impact ofany predictive feature on the predicted sales volume of first prediction1002. However, as can be seen in connection with second prediction 1004,predictive features that have a significant effect for one predictionmay have a very different effect on a different prediction. For example,item predictive feature 1014 and month predictive feature 1022 have amuch smaller impact on the predicted sales volume and thetwo-dimensional combination week of month-store predictive feature 1026has the second largest impact of predictive features 1010-1034 forsecond prediction 1004. In comparison, the predicted sales volume ofthird prediction 1006 is affected greatest by item-store predictivefeature 1016 and store-trend predictive feature 1012.

As stated above, cyclic boosting system 110 generated predictions1002-1006 using cyclic boosting model 204 and training data 220comprising historic sales data set from January 2013 to the end of 2016for 10 different stores and 50 different items comprising the fields:date, store, item, and sales, wherein sales is the target to predict.The results of predicting sales for the first three months of 2017 usingmethod 300 of cyclic boosting were compared with winning models from aKAGGLE competition using the same exemplary historic data set. Asdescribed below, the comparison demonstrates that method 300 of cyclicboosting achieves performance at least comparable to the machinelearning approaches while retaining the benefit of fully explainablepredictions. Using the observed sales in the first three months of 2017and comparing these to the predicted values, the results of method 300of cyclic boosting comprise a symmetric mean absolute percentage errorof SMAPE≈13:20%. Similarly, using a data set comprising historical salesfrom January 2013 until December of 2015 and predicting sales for thefirst three months of 2016 yields a SMAPE≈13:57%. In comparison, themachine learning models of the KAGGLE competition, discussed above, weretrained with machine learning models with historical data from theexemplary data set from 2013 through 2017 and predicted the first threemonths of 2018. These machine learning models comprise a SMAPE≈13:84%and SMAPE≈12:58% for 34% and 66% of the data set for the first threemonths in 2018. Accordingly, method 300 of cyclic boosting providescomparable performance with other machine learning models whileretaining full explainability of the individual predictions. Embodimentscontemplate using historical data that includes information on prices,promotions, or product hierarchy and dependency on events, likeholidays, weather, or other exogenous variables.

Example 2

By way of explanation and not of limitation, a second example of method300 of cyclic boosting is now given in connection with predicting medianhouse value for exemplary California housing data based on a SCIKITLEARN open source software package data set. This exemplary Californiahousing data contains 20,640 observations of the dependent variabley=ln(median house value), where the median house value is measured inthousands of U.S. dollars and calculated for households within a block.A randomly selected sample comprising thirty-percent of the data wasretained as testing data. In addition to the feature variables includedin the dataset, cyclic boosting system 110 constructed the followingfeatures, which were added to the list of feature variables: AverageOccupancy/Average Rooms; Average Bedrooms/Average Rooms; ak-nearest-neighbors regressor using the latitude and longitude asfeature variables and the dependent variable as target variable; allpossible two-dimensional combinations of the individual features.Additionally, in this example, variables latitude and longitude weredropped after calculating and including the k-nearest-neighborsregressor.

Using these features, the mean squared error (MSE) between predictions ŷand true values y was MSE^(test)≈0.197 when evaluated on the independenttest sample and MSE^(train)≈0.183 when evaluated on the training sample.The small difference between these numbers provides an indication thatcyclic boosting model 204 was not significantly over-trained in thisexample.

For comparison, a model using the gradient boosting regressor providedby SCI-KIT LEARN resulted in MSE^(test)≈0.199 and MSE^(train)≈0.107,respectively. For this, the same features described in connection withthe second example were provided to the SCI-KIT LEARN model, except forthe two-dimensional combinations generated by cyclic boosting system 110(i.e. k-nearest-neighbors regressor and two-dimensional constructedfeatures, described above.) Cyclic boosting system 110 optimized thehyper-parameters by grid search, which resulted in a maximum number ofnodes in the individual regression trees of 6, which provides anindication that the quality of cyclic boosting model 204 may be improvedby adding higher-dimensional feature combinations. This comparisonindicates that method 300 of cyclic boosting achieves comparableprediction quality with better generalization.

FIG. 11 illustrates features contribution visualization 1100, inaccordance with a second embodiment. Features contribution visualization1100 comprises a visualization of three exemplary observations 1102-1106and contributions from predictive features 1110-1122 in connection withthe SCI-KIT LEARN data set described above. By way of example only andnow of limitation, individual observations 1102-1106 are displayed ontop of each other, and only the listed features have been used for thisillustration, temporarily removing all two-dimensional features and theratios described earlier.

Continuing with this example, predictive features 1110-1122 compriseaverage number of bedrooms 1110, average number of occupants 1112average number of rooms 1114, house age 1116, median income 1118 (medianhousehold income in the geographical region (in this example, the block)where the house is located), population 1120 (quantity of peopleresiding in the geographical region), and average of nearest neighbors1122 (k-nearest-neighbors regressor combining latitude and longitudevalues and correlating the latitude and longitude values to the target).As seen in connection with first observation 1102, second observation1104, and third observation 1106, average of nearest neighborspredictive feature 1122 has the most significant impact on the targetvariable (natural log of median house value) which is indicated by acorresponding feature factor value 1108 of average of neighborspredictive feature 1122 comprising a value (i.e. 1.2, 0.4, and 1.6) thatis significantly greater than feature factor values of other predictivefeatures 1110-1120. In comparison, a second-most impactful predictivefeature for first observation 1102 and third observation 1106 is averagenumber of occupants 1112, but is medium income predictive features 1118for second observation 1104. As indicated by features contributionvisualization 1100, the importance of each individual predictivefeatures 1110-1122, from which the final prediction is calculated,varies strongly from one observation to the next.

Reference in the foregoing specification to “one embodiment”, “anembodiment”, or “some embodiments” means that a particular feature,structure, or characteristic described in connection with the embodimentis included in at least one embodiment of the invention. The appearancesof the phrase “in one embodiment” in various places in the specificationare not necessarily all referring to the same embodiment.

While the exemplary embodiments have been shown and described, it willbe understood that various changes and modifications to the foregoingembodiments may become apparent to those skilled in the art withoutdeparting from the spirit and scope of the present invention.

What is claimed is:
 1. A computer-implemented method of explainablesupervised machine learning cyclic boosting for prediction andexplanation of future customer demand quantities, comprising: receiving,by a server comprising a processor and a memory, historical sales datacomprising aggregated sales data for one or more items from one or morestores for at least one past time period, wherein the one or more storesmaintain an inventory of the one or more items at one or more stockinglocations; binning categorical features from the historical sales dataaccording to feature categories; binning continuous features from thehistorical sales data; training a cyclic boosting model to learn modelparameters by iteratively calculating, for each feature and each bin,one or more factors for at least one full feature cycle, wherein atraining period is earlier than a prediction period, and each of one ormore demand quantities is associated with at least one item of the oneor more items and at least one stocking location of the one or morestocking locations during the prediction period, and wherein trainingthe cyclic boosting model to learn the model parameters by iterativelycalculating, for each feature and each bin, the one or more factors forthe at least one full feature cycle, comprises: calculating, for each ofthe one or more factors, partial factors for target values based on aniteratively calculated ratio of an actual value of a target for eachfeature and each bin to a predicted value of the target for each featureand each bin; calculating aggregated factors based on the calculatedpartial factors; and predicting the one or more demand quantities duringthe prediction period by training a prediction model on historicalsupply chain data; and rendering, for display on a user interface, ademand prediction feature explanation visualization comprising apredicted demand and one or more features identified during the trainingof the prediction model that influence the predicted demand.
 2. Thecomputer-implemented method of claim 1, further comprising: stopping thetraining of the cyclic boosting model based on reaching a stoppingcriteria.
 3. The computer-implemented method of claim 1, furthercomprising: rendering, for display on the user interface, one or moreinteractive graphical elements for selection of the one or more itemsand stores; in response to the selection of the one or more items andstores, retrieving the one or more factors influencing the predicteddemand; and rendering, for display on the user interface, avisualization comprising one or more graphical elements identifying theone or more features and the one or more retrieved factors.
 4. Thecomputer-implemented method of claim 1, further comprising: rendering,for display on the user interface, one or more interactive graphicalelements that provide for modifying one or more future states of the oneor more features identified by the cyclic boosting model during thetraining; and in response to modifying the one or more future states ofthe one or more features, modifying input values to represent a futurescenario corresponding to the modified one or more future states of theone or more features.
 5. The computer-implemented method of claim 1,further comprising: binning continuous features, wherein each bin hasone or more of a same width or a same quantity of observations.
 6. Thecomputer-implemented method of claim 1, wherein the predicted valuesfollow a Poisson distribution.
 7. The computer-implemented method ofclaim 1, wherein the visualization categorizes, ranks and evaluates thefeatures of the cyclic boosting prediction.
 8. A system of explainablesupervised machine learning cyclic boosting for prediction andexplanation of future customer demand quantities, comprising: a server,comprising a processor and a memory, configured to: receive historicalsales data comprising aggregated sales data for one or more items fromone or more stores for at least one past time period, wherein the one ormore stores maintain an inventory of the one or more items at one ormore stocking locations; bin categorical features from the historicalsales data according to feature categories; bin continuous features fromthe historical sales data; train a cyclic boosting model to learn modelparameters by iteratively calculating, for each feature and each bin,one or more factors for at least one full feature cycle; wherein atraining period is earlier than a prediction period, and each of one ormore demand quantities is associated with at least one item of the oneor more items and at least one stocking location of the one or morestocking locations during the prediction period, and wherein train thecyclic boosting model to learn the model parameters by iterativelycalculating, for each feature and each bin, the one or more factors forthe at least one full feature cycle, comprises: calculate, for each ofthe one or more factors, partial factors for target values based on aniteratively calculated ratio of an actual value of a target for eachfeature and each bin to a predicted value of the target for each featureand each bin; calculate aggregated factors based on the calculatedpartial factors; and predict the one or more demand quantities duringthe prediction period by training a prediction model on historicalsupply chain data; and render, for display on a user interface, a demandprediction feature explanation visualization comprising a predicteddemand and one or more features identified during the training of theprediction model that influence the predicted demand.
 9. Thecomputer-implemented method of claim 1, wherein the server is furtherconfigured to: stop the training of the cyclic boosting model based onreaching a stopping criteria.
 10. The system of claim 8, wherein theserver is further configured to: render, for display on the userinterface, one or more interactive graphical elements for selection ofone or more items and stores; in response to the selection of the one ormore items and stores, retrieve the one or more factors influencing thepredicted demand; and render, for display on the user interface, avisualization comprising one or more graphical elements identifying theone or more features and the one or more retrieved factors.
 11. Thesystem of claim 8, wherein the server is further configured to: render,for display on the user interface, one or more interactive graphicalelements that allow for modification of one or more future states of theone or more features identified by the cyclic boosting model during thetraining; and in response to modification of the one or more futurestates of the one or more features, modify input values to represent afuture scenario corresponding to the modified one or more future statesof the one or more features.
 12. The system of claim 8, wherein theserver is further configured to: bin continuous features, wherein eachbin has one or more of a same width or a same quantity of observations.13. The system of claim 8, wherein the predicted values follow a Poissondistribution.
 14. The system of claim 8, wherein the visualizationcategorizes, ranks and evaluates the features of the cyclic boostingprediction.
 15. A non-transitory computer-readable medium embodied withsoftware for explainable supervised machine learning cyclic boosting forprediction and explanation of future customer demand quantities, whereinthe software, when executed: receives historical sales data comprisingaggregated sales data for one or more items from one or more stores forat least one past time period, wherein the one or more stores maintainan inventory of the one or more items at one or more stocking locations;bins categorical features from the historical sales data according tofeature categories; bins continuous features from the historical salesdata; trains a cyclic boosting model to learn model parameters byiteratively calculating, for each feature and each bin, one or morefactors for at least one full feature cycle; wherein a training periodis earlier than a prediction period, and each of one or more demandquantities is associated with at least one item of the one or more itemsand at least one stocking location of the one or more stocking locationsduring the prediction period, and wherein trains the cyclic boostingmodel to learn the model parameters by iteratively calculating, for eachfeature and each bin, the one or more factors for the at least one fullfeature cycle, comprises: calculates, for each of the one or morefactors, partial factors for target values based on an iterativelycalculated ratio of an actual value of a target for each feature andeach bin to a predicted value of the target for each feature and eachbin; calculates aggregated factors based on the calculated partialfactors; and predicts the one or more demand quantities during theprediction period by training a prediction model on historical supplychain data; and renders, for display on a user interface, a demandprediction feature explanation visualization comprising a predicteddemand and one or more features identified during the training of theprediction model that influence the predicted demand.
 16. Thecomputer-implemented method of claim 15, wherein the software, whenexecuted, further: stops the training of the cyclic boosting model basedon reaching a stopping criteria.
 17. The non-transitorycomputer-readable medium of claim 15, wherein the software, whenexecuted, further: renders, for display on the user interface, one ormore interactive graphical elements for selection of one or more itemsand stores; in response to the selection of the one or more items andstores, retrieves the one or more factors influencing the predicteddemand; and renders, for display on the user interface, a visualizationcomprising one or more graphical elements identifying the one or morefeatures and the one or more retrieved factors.
 18. The non-transitorycomputer-readable medium of claim 15, wherein the software, whenexecuted, further: renders, for display on the user interface, one ormore interactive graphical elements that allow for modifying one or morefuture states of the one or more features identified by the cyclicboosting model during the training; and in response to modification ofthe one or more future states of the one or more features, modifiesinput values to represent a future scenario corresponding to themodified one or more future states of the one or more features.
 19. Thesystem of claim 15, wherein the server is further configured to: bincontinuous features, wherein each bin has one or more of a same width ora same quantity of observations.
 20. The non-transitorycomputer-readable medium of claim 15, wherein the predicted valuesfollow a Poisson distribution.